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As oral communication becomes a more substantial 
feature of courses in disciplines other than speech communication, 
faculty members in other disciplines need to develop the ability to 
assess oral communication competence in their classrooms. Faculty 
development workshops can teach colleagues these skills, using 
consultations with faculty members who can tell how they applied what 
they learned in earlier workshops, practicing the assessment of 
sample student performances provided on tape or in person, and 
providing follow-up sessions periodically after the formal workshop 
i.. over. Fundamental issues involved include (1) whether form and 
content are related; (2) how much communication depends on its 
context; and (3) whether evaluation should- be analytic or holistic. 
Classroom assignments — oral reports, debates ; and role-playing — can 
incorporate speech communication into different disciplines. However, 
using a wide variety of speaking and listening assignments requires a 
broad range of methods for assessing student performance, including 
rating scales, which translate easily into numerical scores; check 
lists, based on the completion of specified behavioral objectives; 
holistic evaluation, where judgment is seen as a contextual 
adaptation; and peer eva].uation. Problems faced by faculty seeking to 
implement speaking skills include how to evaluate listening, and how 
to deal with students who never speak in class, or who demonstrate a 
high level of anxiety. (Ten references are appended.) (MM) 
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TEACHING COLLEriDUES IN OTHER DISCIPLINES 
TO ASSESS COMMUNICATION COMPETENCY 



This paper is designed to review considerations and 
procedures appropriate -for assisting -faculty members in 
disciplines other than speech communication to assess the 
speaking and listening skills o-f students in their own 
classrooms. 

Faculty development programs, beginning with a notable 
surge in the l?70s3, have decome increasingly prevalent in 
colleges and universities (Ga-f-f, 1975; Centra? 1976). In 
these programs, teachers in every -field are being urged to 
make greater use o-f "active modes o-f teaching and learning" 
(Involvement In Learning, 1985j, p. 27). Faculty who are 
expanding their repertoires o-f teaching resources are 
searching -for ways to increase student participation in their 
classes. 

With the exploration o-f active teaching modes came a 
sensitivity to the role o-f speaking and listening throughout 
the institution. Instructors o-f economics, -for instance, 
have testi-fied that Introducing oral communication processes 
in their courses has provided the students "with a sense o-f 
ownership o-f their product and o-f the class" (Field, Wachter, 
and Catanese, 1985, p. 216). In a number o-f casef^, 
institution-wide programs have been established to ensure the 
existence of speaking-intensive courses in the curriculum 
(Weiss, 1982; Roberts, 1983; Loacker, at al., 1984; 
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Stein-fatt, 1986). We hav^^j, then;, a relatively -fresh 
phenomenon, Speaking and Listening Across Disciplines 
(SALAD) . 

As oral communication becomes a more substantial -feature 
of their courses, -faculty members start thinking about how to 
evaluate the behavior*^ which they have encouraged in their 
students. They voice a concern about "assigning and 
evaluating oral presentations" (Cooper and Galvin, 1986, 
p. 4). Not in-f requently the concern about evaluation leads 
them to the instruments and processes which speech 
communicati on pro-f essi onals have -found use-f ul . Teach i ng our 
colleagues appropriate evaluation methods -for speaking and 
listening then becomes a resoonsibi 1 i ty o-f those o-f us in 
this -field. 

Because most o-f the in-formation I will be presenting 
here is based upon my e;;perience at DePauw University, let me 
give you a quick picture o-f what is going on there. At 
DePauw, every student as a graduation requirement must enroll 
in at least one designated "speaking intensive" course. 
(Similar requirements eitist in writing and mathematics.) The 
grade sheets -for these courses have a separate column -for 
indicating whether the oral communication o-f the student has 
been judged competent i n that course. The rather complex 
supporting system -for this graduation requirement includes a 
preliminary assessment o-f all -freshmen students (Note 1), a 
Speaking and Listening Center to provide assistance to 
students in all disciplines, and -faculty workshops to train 
•faculty members who will o-f-fer and conduct the speech 



intensive courses. (They can-'t so designate their courses 
unless they complete the workshop.) 

Be-^'Cire going -furtherj, let me make a distinction and then 
blur it a little. The di st i net i on is between (1) evaluating 
a student" s oral communication performance in a course and 
(2) evaluating the student^s comprehension o-f the content o-f 
the course as expressed through oral performance. 

In the speech intensive courses (known as "S" courses) 
at DePauw, instructors are expected to evaluate oral 
communication per se. The instructor's evaluation is 
employed explicitly as an oral communication assessment 
procedure by the university. As mentioned, there's a 
separate column on the grade sheet where this assessment is 
recorded. Thus a student may pass a course (on the basis o-f 
written tests, papers, laboratories, etc.) and still not be 
given credit -for oral communication competence, and vice 
versa. Speaking and listening competence is evaluated in 
such courses much as they might be in a speech class. 

More common in higher education, o-f course, is the 
situation where faculty members in any discipline evaluate a 
student's understanding o-f the material o-f the course itsel-f 
(philosophy, biology, etc.) through oral assignments, much as 
they would grade written evidences o-f comprehension. Grades 
based on oral participation may constitute a certain 
percentage o-f the -final grade in the course. As a milder 
version o-f this pror-Hure, some teachers will "nudge" a grade 
upward -for superior class participation. 

In practice the distinction between "content" and its 



commaication is considerably blurred. A poorly organised 
oral report suggests a lack o-f understanding about the 
subject matter of a discipline, just as may an inappropriate 
(though factually '^correct") response during a class 
discussion, or a relevant vocabulary and even a sophisticated 
vocal inflection may positively indicate an especially firm 
grasp of the field. Likewise, when one is judging 
communication competence, knowing whot one is talking about 
is a highly relevant consideration. The "good speaker" who 
doesn^'t know what he is talking about, no matter how many 
votes he may get in a Presidential election, is not to be 
rewarded in the academy. Thus judgments about communication 
and knowledge overlap considerably in actual practice- 
Content and its communication are strongly interwoven- 

□ur concern here will be to describe procedures used in 
faculty workshops which have been conducted to assist 
teachers across the curriculum to assess oral communication 
competence in their classrooms. The same procedures would be 
applicable for helping any faculty members who plan to 
incorporate a substantial oral communication component in 
their courses. 

After a description of the general features of such 
faculty development worksnops, attention will be given to (1) 
addressing fundamental issues, (2) surveying oral 
communication assignments, (3) assessment instruments, and 
(4) special problems. Finally, some reflections about 
faculty attitudes toward oral communication will be 
presented. 
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Workshops 

Faculty development is currently a -full-blown enterprise 
in many institutions, and "workshops" are usually an 
important part o-f it. The most engaging -feature o-f such 
workshops, it turns out, is the atmosphert? o-f camarr.ieri e and 
sharing that -frequently develops. "Teaching" colleagues, 
about oral communication or any other subject, o-ften consists 
o-f mutually sharing and discovering the -frequently 
imaginative and provocative things we and these colleagues 
are doing in our various disciplines. 

Normal workshop procedures re-flect the sharing atmosphere 
in relying heavily upon discussion and reports -from members 
about what they are doing or planning, supplemented by the 
ubiquitous "hand-outs," talks by visiting consultants, and 
ejjercises o-f various kinds. Three items which have proven 
especially help-ful in workshops on assessing oral 
communication across the curriculum are (1) consultations 
with -faculty members who have taken earlier workshops and can 
tell how they applied what the/ learned, (2) practice in 
assessing sample student pe-formances orovided on tape or in 
person, and (3) adequate -follow-up in re-fresher sessions held 
periodically a-fter the -formal workshop is over. Attached is 
an outline o-f a typical -faculty workshop in this area at 
DePauw Uni versi ty. 
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Addressing Fundamental Issues 



In evaluating oral communication in their classrooms, 
instructors will naturally make assumptions concerning the 
nature o-f communication, the learning process, tests and 
evaluation^ and the expectations o-f competence. In -figuring 
out how to assess speaking and listening, we begin by -finding 
our position with regard to some -fundamental issues. The 
idea is not to indoctrinate anyone, but to make sure that the 
inevitable choices o-f position are based upon a considered 
and in-formed del iberation. 

Treatment o-f -fundamental issues with respect to 
communication itsel-f is especially important. For instance, 
one o-f the most basic issues is "How are -form and content 
related?" Some -faculty members will take the position that 
content has an independent existence, and the -form it takes 
in communication is essentially a representation or 
re-flection o-f that content. Other individuals may take 
another pole and say that all content consists o-f structure, 
and that whenever we communicate we are "creating" reality or 
knowledge. Points o-f view are avai lable all along this 
continuum. In evaluating a message an instructor will need 
to consider whether that message i s expected to m^^tch a 
posited reality .or to be seen as a freshly structured 
creation . 

A second -fundamental communication issue might be "Where 
does meaning reside?" Is the message whatever the instructor 
gets out o-f the symbols being expressed by the student? Or 
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would it be the meaning derived by the other students in the 
class, who are, after all, its intended audience? Or is the 
"meaning" encompassed in the intent of the speaker who makes 
the utterance? Which message are we evaluating? 

A third issue in communication which any -faculty member 
will have to -face is "How much does communication depend on 
its context?" Some will subscribe to the doctrine that good 
speech is always good speech. Others will assume that speech 
which may be regarded as good in one situation may be poor in 
another • 

There are a number o-f other -fundamental issues i n 
communication which may be addressed depending upon the aims 
o-f the teachers. For instance, an answer to the question, 
"How much does communication depend upon language?", may 
in-fluence evaluations considerably. One instructor may see 
speaking as "writing an its hind legs," simply language 
uttered out loud, while another viewpoint will be that 
communication is a complex' set o-f social behaviors with 
nonverbal symbols constituting an important element. 

Going beyond such issues in communication will get us 
into important questions about learning, about testing, and 
about competence which all teachers who do any grading o-f any 
kind have to consider. 

In our V i ew o-f the 1 earni ng process we raise such issues 
as "What is the role o-f the student?" (to be enlightened by 
subject-matter experts or to be engaged in a learning 
environment) and "How do we learn?" (through correction or 
through rein-f orc»ment ) . I-f the answer to the -first one 



indicates that a -f aci 11 tati ve environment and sharing o-f 
ideas is the desideratum, then the teacher plays as big a 
part in the communication process as the student does, if 
the communication is poorji who gets the bad grade,. the 
student or the teacher? On many o-f these questions, of 
course, intermediate positions are available. 

Among the potentially relevant issues with regard to 
testing is the question, "Should evaluation be analytic or 
holistic?" Some teachers will expect to rate students on a 
number o-f explicit criteria, while others pre-fer making more 
global judgments about a performance as a whole. 

Judgments about general competence will be more 
important at DePauw than in most other programs, but a 
position on an issue such as "How cognitive is competence?" 
may be relevant to others. This is, after all, an issue 
which is central to a definition of communication competence. 
Is it enough just to perform adequately, or should students 
also know VJhat they ^ re doing? 

Developing a viewpoint on such issues provides a basis 
for making satisfying evaluations of oral communication in 
the classroom. 

Surveying Assignments 

Faculty members from different disciplines having 
different approaches to teaching may become interested in 
implementing a wide range of oral communication assignments, 
going well beyond traditional class discussion and oral 
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reports. Part o-f the process o-f assisting them in evciluating 
speaking and listening is surveying such assignment 
possibi 1 ities. 

There are a multitude o-f -formats and uses o-f speaking 
and listening which have possibly not occurred to instructors 
in a given subject or which they are reluctant to use because 
they don't know much about them. Instructors quite 
-frequently ask questions such as *'How exactly do you go about 
setting up class debates?" Most teachers have tried breaking 
larger classes into smaller groups -for discussion purposes, 
but aren't so aware o-f the varieties of structure and 
purposes available in group work. Buzz groups, project 
groups, brainstorming groups, and others may give variety to 
a course and helf. meet educational objectives more 
e-f-f ecti vel V. One o-f the most underutilised activities is 
oral reading, which sometimes turns out to be much more 
educational and meaningful than original student discourse. 
Or '*role-pl aying'* may be introduced as a -form o-f speaking and 
listening suitable -for classrooms as diverse as history and 
ecology, one which many instructors have not seriously 
consi dered . Fi nal 1 y, but hardl y exhaust i vel y, audi o and 
videotaping have become almost universally accesisible in 
classrooms, providi ng new opportunti es -for i magi natl vg 
applications to the learning process. 

This is a portion o-f a workshop where haring of 
experience is especially appropriate. In one workshop, for 
instance, a philosophy professor introduced us to a 'Veferat** 
system, under which one member of a class is assigned to take 



i 



11 



9 



notes on each day^s class discussion and distribute copies of 
the notes to the other students, A history teacher rxplained 
a complejj -format for conducting role-plaving debates in his 
Irish history course. Most instruccors have some assignment 
variations which they have -found conducive to learning in 
their own courses. 

We may suggest that auxiliary speaking and listening 
components be added to the assignments which are already part 
of the course syllabus. Requiring an oral report along with 
a written paper is a typical maneuver. Requiring that 
interview procedures be used as a research method or that 
students consult among themselves as they prepare their 
research will provide additional oral communication elements 
even when the performance cannct be evaluated by the 
instructor ""s direct observation. (Such activities may be 
evaluated indirectly through notebooks and diaries., if they 
wish, however.) The concept of "intervention" is one v^orth 
introducing in connection with assignments, also. 
Intervention, taking such forms as a conference with the 
instructor prior to giving an Or'al report or panel 
di scussion 5 helps to br i dge the gap between gi vi ng a speak i ng 
assignment to the students and havi ng it compl eted in cl ass . 

Introducing a number of usable sample assignments to 
flesh out the survey of available options provides concret. 
examples to be emulated. One of the more popular "hand-outs" 
in the DePauw v^orkshops is a so-called "Recipe Book," which 
presents not only the ingredients of a good assignment, but 
examples of specific assignments and syllabi from speaking 
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intensive courses which have been o-f-fered in various 
disciplines in the past- 

As -far as eval uat i on goes, al 1 o-f these var i ed 
assignments may be used to judge speaking competence or 
knowledge o-f the subject-matter o-f the course, or both. This 
means that as they are adopted special attention must be 
given to appropriate methods o-f judging them. There are 
di-f -f erences between evaluating a debate and an oral reading 
•for instance. Appropriate instruments or observational 
methods must ordinarily be considered along with the 
assi gnment var i at i on - 

Assessment Instruments 

Faculty who are utilising a wide variety o-f speaking and 
listening assignments will require a similarly broad range o-f 
methods -for assessing student per-f ormance. To help them out, 
we can provide a relatively systematic review of some of the 
common approaches to speech evaluation. 

(Rating scales. ) Teachers who are incl ined toward 
anal yti cal evaluation methods are especial 1 y attracted to 
rating scales of the sort found in i ns cructor s manuals for 
speech tejitbooks. When rating scales are used, both the 
teacher and the student '*know what they are looking for." 
Furthermorep such scales translate rather easily into 
numer i cal scores for gradi ng purposes and the i tems on the 
seal e can be adapted and modif \ ed accord i ng to the speci al 
needs of a given course. A faculty development workshop is a 
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good setting -for surveying and d€=»veloping -forms o-f this kind. 

Un-f ortunately, teachers who like to use these -forms must 
be warned about the distortions, -false precision, and other 
evaluation pit-falls which are characteristic o-f rating scales 
in speaking and listening. They need to be apprised o-f the 
possibi lities o-f leniency, halo, and trait di stortions (Bohn 
and Bohn, 1985) . And i-f the standards are to have 
institution-wide si gni-f icance, explicit training in using the 
scales will be necessary. 

(Check-lists) The -forms they use need not necessarily be 
scales, though. In an achievement-based situation the goals 
are explicit cr iter ion-re-ferenced behavioral objectives which 
are either met or not met. "Participate actively in each 
class discussion" might be such a goal. In the DePauw 
program, where competence evaluations do not have to be 
scored, and where "ex it standards" -for S-courses are 
speci-fied, we rely con«=iderably upon goal achievement o-f this 
kind . 

(Holistic Evaluation) Where judgment is seen as a 
humanistic enterprise and contextual adaptation to a 
particular classroom is al 1-^important , teachers may be 
encouraged to adopt hoi isti c evaluation procedures. To Judge 
one student to be "excellent" and another one as "fair" is 
manageable -for experienced teachers. Scale items and check 
lists may then be used to identi-fy strengths and weaknesses 
which contributed to the judgment. 

(Other Methods) Instructors may also need to know that 
there are numerous other ways to evaluate oral communication, 
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as well. One may make judgments in terms o-f responses, -for 
instance. The listeners may be tested over the material the 
presenter has purportedly covered., or the instructor may look 
at notes the other students have taken. The teacher may 
employ standard (or non-standard) discursive critical methods 
such as application o-f criteria, anc^logs^ and generic 
systems. A complete course in rhetorical criticism is hardly 
■feasible in a -faculty developmei t workshop, but -faculty 
members may well be able to share? the critical methods with 
which they are already -familiar. 

(Peer evaluation) The judgments o-f peers are not 
necessarily inappropriate as an instrument, either. A-fter 
all, the peers are the persons to whom the communication is 
addressed. Their commsnts, and even their ratings, provide 
another supplemental option -for an instructor to use. 

Practical ejtperience in using these methods., normally 
available in a workshop situation, may be important in 
-familiarizing the -faculty members with them and bringing to 
their attention the substantial disparities which may turn up 
in the results when administered by their various colleagues. 
A collection o-f videotapes o-f student presentations o-f 
reports and panels and per-formance in class discussions can 
serve as a basis -for practice in evaluation and discuss>ion o-f 
the application of evaluation instruments. Sometimes we have 
students come personally into the workshop to get a critique 
or we even visit an ongoing class. It should be remembered, 
-for that matter . that communi cati on i s al ways contejitual and 
the ultimate concern o-f an instructor in any discipline is 
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the e-f-ficacy o-f the speaking and listening as related to what 
is going on in a particular class in a particular discipline. 

Fami I iar ity with assessment methodol ogies and their 
employment in varying situations iz: one o-f those -features o-f 
•faculty development in speaking and listening which may be 
continually augmented through re-fresher meetings, mutual 
classroom visitation, and lunchtable conversation. 

Special Problems 

In any e-f-fort to assist -faculty members across the 
curriculum to incorporate student speaking and listening 
behaviors explicitly into their courses and to evaluate these 
behaviors appropriately, we -find that there are many phases 
o-f oral communicat i on we can try to cover p Some o-f the 
topics which -frequently come up in -faculty workshops include 
giving assignments, public speaking, small group dynamics, 
leadership, language use, questions and answers, listening, 
and anxiety. G-f these topics, "listening" and "an;;iety" seem 
to pose special di-f-f iculties. 

"Listening" remains one c-f the areas o-f the speech 
communication -field where the recognition o-f^ its importance 
outruns the ability to teach and evaluate it. Increasing 
consideration, in terms o-f research and articles, te;;tbooks, 
and organisations, is being given to this area. Still, there 
are -few pat answers to be given to those who ask, especially, 
"How do I evaluate listening?" In a workshop, even "sharing" 
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procedures produce at best some anecdotal material , usually 
in the -form o-f horror stories- In developing syllabi and 
assignments, teachers can be encouraged to incorporate 
specific listening -features. As -for evaluation, some 
directions which can be explored include (1) keeping track o-f 
overt listening behaviors such as nonverbal cues and 
appropriately referenced oral contributions, (2) evaluating 
■feedback in terms o-f such -factors as remembering and level o-f 
questions asked, and <3) noting ultimate success or -failure 
to grasp material and concepts as exhibited in e:caminations 
and papers. 

Most i nst rue tors are anx i ous about the anx i ety o-f the: i r 
students. They want to know how to deal with the students 
who don^t talk at all in class or whose per-formance they 
observe to be impeded by apprehensive behaviors. The area o-f 
communication comprehension mani-festly constitutes a second 
major di -f -f icul ty in teaching and evaluating oral 
communication. Faculty members may be introduced gently to 
the extensive literature on the subject and concepts such as 
state and trait anxiety, unv;i 1 1 i ngness to communicate, 
rhetori therapy, norms and roles, and phobic behavior in order 
to dispel any simplistic or universalized causal attributions 
instructors so o-ften make. They may also be introduced to a 
range o-f relatively therapeutic measures, not excluding an 
examination o-f their own classroom behaviors which may 
intimidate students into silence. Finally, they can see what 
kinds o-f developmental and compensatory methods are available 
-for making this element less decisive in the evaluation o-f 
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oral commun i c at i on • 

A workshop, then^ may not produce final and comforting 
answers to classroom problems, but an increased awareness of 
their complexities may contribute to better use and 
evaluation of oral communication. 

Some Attitudes 

In any college faculty the climate of opinion about oral 
communication in general and student speaking and listening 
in particular is a mixed one. As one sorts out the attitudes 
of teachers one finds some that are conducive to utilization 
and evaluation of student speaking and listening and some 
which are less so. 

In our experience most teachers do believe that students 
learn "better" wlJen they participate in class and that 
student realisation of a participation expectation leads them 
to prepare better for class. Many would agree that students 
can learn from one another and that student feedback can help 
the teacher to adapt material to student understanding. 
These att i tudes 1 ead f acul ty members to encourage oral 
participation. 

Some other att i tudes they have 1 ead them i n the other 
direction. Many instructors appear to be considerably 
bothered by quest i on s of "f ai rness, " for i nstance. The 
believe that evaluating students on their oral work does not 
seem fair to the ones who are not comfortable talking, and 
treati ng students equal ly seems much more difficult in oral 



situations than when written e5<aminations are used. They 
almost all think that they can't "cover" as much material 
when they allow student participation. Furthermore, criteria 
•for judging oral participation and performance seem to some 
to be more ambiguous and difficult to apply than criteria for 
written work. And attention given explicitly to speaking and 
listening behaviors may detract from attention given to the 
subject matter of the course. Such attitudes, which may well 
be justified, constitute the environment in which we work 
when teaching our colleagues in various disciplines to assess 
the quality of speaking and listening in their classrooms. 

In conclusion, a workshop approach to faculty developmnt 
seems to us to provide an appropriate method for teaching 
professors to evaluate and assess oral communication across 
the college or university curriculum. Such a workshop should 
include an orientation to important issues concerning 
communication, provide them with adequate assignment options 
and assessment instruments, and allow for the sharing of 
ejjperience to generate a broader perspective on communication 
processes and standards. 
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NOTE 



(Note 1) The present paper does not consider the task of 
training raters from other disciplines to administer such 
standard instruments as the Communication Competence 
Assessment Instrument, This training ,has also been part 
of the DePauw program. See Weissj, 1982. 
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1986 FACULTY SUMMER WORKSHOP IN ORAL COMMUNICATION CQMPETENCC 



Tuesday, Resource Person: Thomas Stein-fatt, Clarkson U. 
May 27 Session 1 An approach to oral communication 

Session 2 Communication simul ation 

W:)rkshop Luncheon 

Session 3 Review o-f course syllabi 
Sessi on 4 Usi ng communi cati on "modul es" 



Wednesday, 
May 28 

Thursday, 
May 29 



Session 5 Issues in communication competence 
Session 6 Conducting class discussion 

Resource Person: Tony Catanese 

Session 7 Planning and evaluating class work 
Session 8 Dealing with speech an;;iety 



Friday, 
May 30 

Monday, 
June 2 



Tuesday, 
June 3 



Wednesday, 
June 4 



Thursday, 
June 5 

Friday, 
June 6 



Session 9 



Review o-f model assignments 



Resource Person: Ann L. Weiss 

Session 10 The Speaking and Listening Center 
Session 11 Review o-f e;;it standards 

Resource Person: James Rambo 

Session 12 "S" competence in -foreign languages 
Session 13 Practicum in evaluating 

Resource Person: Ernest Henninger 

Session 14 Sharing o-f views 

Session 15 Stimulating class participation 

Session 16 Li stening 

Session 17 Orienting students to an '*S*' course 

Session 18 Presentation o-f syllabi 
Final Workshop Banquet 



Workshop Participants: Richard Curry, Arthur Evans, Walker 
Gilmer, Alan Pankrats, Donald Ryujin. Daniel Wachter, and 
Edward Ypma 



Workshop Director: Robert Weiss 



